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1.  Abstract 


One  of  the  realities  in  astronomical  imaging  from  the  earth  is  the  negative  affects  introduced  by  the  atmosphere.  In 
order  to  counteract  the  effects  of  the  atmosphere,  we  propose  the  use  of  a  3  channel  polarimeter  and  associated 
deconvolution  algorithm.  The  3  channel  polarimeter  features  three  focal  plane  arrays  simultaneously  imaging  the 
same  object  through  polarization  analyzers  set  at  angles  of  45  and  90  degrees  relative  to  the  reference  channel.  The 
algorithm  is  designed  to  estimate  the  intensity  of  the  object,  its  degree  of  polarization  and  a  term  related  to  its  angle 
of  polarization  when  performing  long  exposure  imaging  and  the  seeing  parameter  of  the  atmosphere  is  known.  The 
results  show  that  a  degraded  image  of  2  point  sources  can  be  successfully  reconstructed  into  an  image  resembling 
the  actual  image  before  the  degradation  occurred. 


2.  Introduction/Problem  Statement 


One  major  problem  with  imaging  objects  in  space  is  the  negative  effects  the  atmosphere  introduces  into  the 
imaging  process.  Specifically,  atmospheric  turbulence  causes  aberrations  in  images  when  viewed  from  the  surface  of 
earth  [3:69].  Fig.  1  demonstrates  the  problem  presented  by  atmospheric  turbulence.  This  scenario  shows  a  star  that  is 
a  great  distance  away  from  the  earth.  The  light  from  the  star  will  naturally  radiate  in  a  spherical  manner,  but  as  it 
travels  a  distance  of  “near  infinity”  it  can  be  assumed  that  there  is  a  plane  wave  input  on  the  lens  of  the  telescope. 

The  plane  wave  starts  out  untilted,  but  as  it  travels  through  the  earth’s  atmosphere  it  is  degraded. 

Atmospheric  turbulence  causes  time  delays  in  the  light  as  it  passes  through  the  atmosphere,  but  the  delay  is 
not  equal  amongst  the  entire  plane  wave.  The  curve  illustrates  how  in  this  case  the  middle  portion  of  the  light  passes 
through  after  the  outsides  pass  through.  This  delay  or  tilt  will  inevitably  have  an  effect  on  the  image  formed  at  the 
detector  of  camera,  which  is  on  the  other  side  of  the  lens  of  a  telescope.  The  lens  of  the  telescope  will  cause  all 
incoming  light  outside  of  its  focal  distance  to  converge  as  shown  towards  the  bottom  of  Fig.  1.  An  ideal  scenario 
would  be  that  the  light  comes  in  untilted  and  forms  an  image  centered  on  the  detector,  but  in  reality  this  is  not  the 
case.  An  input  of  tilted  light  on  a  lens  will  result  in  a  shifted  image  on  the  corresponding  detector,  based  on  the  Shift 
Theorem  of  Fourier  Transforms  [1:8].  After  a  “long”  exposure  time,  there  will  not  be  just  one  shift  of  the  point 
source,  but  an  accumulation  of  many  shifts.  Fig.  1  shows  a  simulated  example  of  an  ideal  image  of  two  point 
sources,  and  the  resulting  blurry  measured  image  at  the  detector.  This  measured  image  is  what  will  be  referred  to 
from  now  on  as  measured  data  d(x,y). 
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Truth  Data 


Fig.  1:  Left- Atmospheric  turbulence  scenario.  Right-Example  of  a  2  point  source  image  (truth  data)  degraded  with 
noise  and  blurring 


3.  Previous  Work 


The  proposed  approach  to  mitigating  the  effects  of  atmospheric  turbulence  in  imaging  systems  is  based  off 
of  a  previous  research  effort  by  Captain  Steven  James,  USAF.  He  researched  a  2  Channel  polarimetric  solution.  The 
results  of  his  simulations  showed  that  a  2  channel  approach  improved  the  sharpness  of  an  image  after  it  had  been 
blurred  by  atmospheric  turbulence.  This  paper  describes  an  attempt  to  take  his  research  one  step  further  and 
investigate  if  adding  on  another  channel  will  provide  sharper  images  and  describe  the  polarization  state  of  the  light 

[4]. 


4.  Scenario  Description 


Polarimeter  Setup 

The  proposed  method  for  solving  the  three  channel  polarimetric  deconvolution  problem  utilizes  the 
Expectation-Maximization  (EM)  algorithm.  The  EM  approach  allows  for  the  unpolarized  image  to  be  computed 
simultaneously  with  the  degree  of  polarization  and  turbulence  parameters.  The  three  channel  polarimeter  is 
designed  with  each  channel  containing  a  polarization  analyzer  set  at  different  angles  with  respect  to  one  another. 
The  polarization  parameters  are  formulated  so  that  there  are  no  angles  to  estimate.  Instead  a  single  matrix  is 
computed  that  is  related  to  the  squares  of  the  sine  and  cosine  of  the  angle  between  the  analyzers  and  the  angle  of 
polarization  in  channels  1  and  2.  Channels  1  and  2  are  set  up  to  be  orthogonal  to  one  another  while  channel  3  is  set 


to  be  at  45  degrees.  This  matrix  removes  the  need  to  estimate  an  angle  through  a  trigonometric  relationship  and 
greatly  simplifies  the  estimation  problem. 


Fig.  2:  Example  3  channel  polarimeter  set  up. 

Key  Measurements  and  Assumptions 

1.  Dominant  source  of  noise  is  modeled  with  a  Poisson  distribution 

2.  ro  is  a  known  and  measured  value 

Equation  1  shows  how  the  SNR  is  calculated  for  all  scenarios.  It  also  shows  how  one  of  the  three  variables 
in  the  denominator  can  be  the  dominant  source  of  noise,  if  it  is  much  greater  than  the  other  two.  represents  the 

thermal  noise,  which  normally  comes  from  the  camera  used  in  observations.  is  the  background  noise  and  it 

is  the  most  important  variable,  since  it  is  the  dominating  source  of  noise  in  all  simulations.  The  main  contributor  of 
background  noise  is  reflected  sunlight,  and  the  contribution  of  noise  can  be  modeled  with  Poisson  statistics. 
[3:18][5:485] 
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At  this  point  in  the  research  phase  it  is  also  important  to  assume  a  known  value  for  ro  for  the  deconvolution 
to  work  correctly.  There  are  ways  to  empirically  measure  ro,  therefore  it  is  not  unreasonable  to  assume  a  known 
value.  As  part  of  the  scope  of  this  research  effort  future  capability  to  accurately  measure  ro  will  be  added. 

Optical  Transfer  Functions  Used 


The  most  severe  degradation  to  the  true  object  in  Fig.  1  is  caused  by  the  long  exposure  optical  transfer 
function  (LEOTF).  This  is  the  OTF  used  to  model  the  atmospheric  turbulence  for  long  exposure  imagery 

t  1  /  ggQ  |"| 

(  ^lOO  '  ”  )  The  primary  reason  the  bottom  image  in  Fig.  2B  (  d(x,y)  )  looks  nothing  like  the  truth  data  is 
due  to  the  LEOTF.  The  formula  for  the  LEOTF  is  given  by  Equation  2  [5:402].  Notice  that  the  resulting  magnitude 
of  Hle  is  solely  dependent  on  rg  (Fried’s  Seeing  Parameter  [5:429]).  This  is  only  true  assuming  that  mean 

wavelength  of  light  the  focal  length  of  the  lens  (/  ),  and  spatial  frequency  (f'‘  )  remain  constant.  Variables 
and  represent  the  spatial  frequencies,  where  subscripts  u  and  v  since  the  OTF  is  only  relevant  in  the  spatial 
frequency  domain. 


(2) 


The  least  significant  contribution  in  the  blurring  of  the  true  object  is  due  to  the  optics  based  OTF  (^a ), 
also  known  as  the  average  OTF,  given  in  Equation  3  [5:364].  represents  the  pupil  function  and  shows  its 

operation  in  the  V-  plane,  which  is  the  plane  of  the  lens.  The  product  of  both  OTFs  gives  the  OTF  for  the  system 
shown  in  Equation  4.  is  the  OTF  used  for  degrading  all  truth  data. 


(3) 


(4) 


Deconvolution  Setup/3  Channel  Polarimeter  Derivation  Summary 

The  heart  of  this  entire  research  effort  lies  in  the  mathematical  derivation  for  the  3  channel  polarimeter.  In 
essence,  this  derivation  explains  the  mathematics  necessary  to  take  a  blurred  noisy  image  and  transform  it  into  a 
sharper  looking  image.  The  six  steps  listed  below  will  briefly  summarize  the  derivation  for  the  3  channel 
polarimeter,  but  first  it  is  necessary  to  define  all  of  the  variables  in  the  derivation  in  the  following  table: 

Table  1:  Definitions  of  the  variables  for  the  3  Channel  Polarimeter  Derivation. 


Detector  Plane  coordinates: 

Observation  Plane  coordinates: 

z,w 

Incomplete  data  (measured): 

di(x,y),  d2(x,y),  dsCx.y) 

Complete  Data  mythical: 

ti'iup  Sx.  y,  L wl,  clipCx, y.  &  tf 2  P  (s, y,  4, w >,  (fi  P  V,  s,  w  > 

True  image  (object): 

o(z,w) 

Simulated  image  (intensity): 

ii(x,y),  i2(x,y),  i3(x,y) 

Point  Spread  Function: 

h(x-z,  y-w) 

Pixels,  or  image  size: 

N 

Polarization  parameter: 

P(z,w) 

Transmission  of  3  polarizers: 

C2^Ei>ir:* -1 -Cip  Cafc,iii>-  i/2+^^iCe 

Step  1 :  Obtain  a  Statistical  Model  for  the  Incomplete  Data  (Measured  Data) 

[fl’i  ?■>]  -  ^  -  T  T  i  ote  ttXi  -  ¥% -&ty  -  +  c^,  -  £v 


Note:  only  half  of  the  light  is  unpolarized,  since  the  polarizer  cuts  half  out 
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Equations  6-8  represent  the  mean  of  the  3  channels  of  data  measured  by  the  CCD  camera.  It  is  important  to 
note  that  double  sum  occurs  over  the  values  z  and  w,  which  are  the  coordinates  in  the  observation  plane  (outer- 
space).  Notice  that  the  intensities  have  coordinates  in  the  x,y  plane,  also  known  as  the  detector  plane  (camera 
detector).  Another  key  component  in  these  equations  is  the  PSF,  h(x-z,  y-w).  The  fact  that  the  PSF  has  a  relation  for 
both  coordinate  systems  should  make  it  stand  out.  This  is  important,  because  this  is  the  set  up  for  a  convolution  to 
occur,  and  the  convolution  is  the  function  that  explains  how  objects  in  the  observation  plane  will  be  seen  in  the 
detector  plane.  Fastly  you’ll  notice  the  P  and  C’s.  Essentially  these  are  just  scalars  on  the  range  from  (0,1). 

Step  2:  Invent  a  Set  of  Complete  Data  (Mythical) 
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The  idea  of  creating  complete  data  is  to  create  the  data  we  “wish”  we  had.  We  “wish”  we  had  this  data 
because  it  is  supposed  to  be  data  that  was  never  blurred  by  a  convolution.  The  convolution  function  is  the 
mathematical  reason  for  the  occurrence  of  blurring.  Also  note  that  the  unpolarized  complete  data  is  the  same  so, 

rr  -V  r> 


Step  3:  Select  a  Statistical  Model  for  the  Complete  Data 

V/;  -  Sv ,v -  -  ¥% 

Where  /’(z,w)=0  in  unpolarized  case 
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The  main  goal  in  selecting  a  statistical  model  is  ensuring  statistical  consistency.  The  complete  data  in  this 
derivation  was  chosen  to  be  Poisson  data,  because  the  sum  of  Poisson  random  variables  is  a  Poisson  random 
variable. 

Step  4:  Formulate  the  Complete  Data  Log-Likelihood 

The  complete  data  log-likelihood  function  is  formulated  assuming  that  the  complete  data  are  statistically 
independent.  Equation  16  shows  the  log  of  the  joint  probability  for  all  of  the  complete  data. 
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Note  that  there  has  been  a  polarization  prior  added  to  the  log-likelihood.  The  main  reason  for  adding  this  is 
to  constrain  the  values  polarization  to  be  between  0  and  1 ,  which  is  “prior”  known  information.  The  PDF  chosen  to 

model  this  prior  is  a  Super  Gaussian,  fiPU  }}  =  PiE>  t  0  .  This  PDF  was  chosen  because  it 

approximates  a  uniform  PDF  on  (0,1)  for  high  values  of  n.  The  log  of  this  PDF  is  what  is  given  at  the  very  end  of 
Equation  16.  [4] 

Step  5:  Determine  Expected  Value 


The  conditional  expected  value  of  the  complete  data  log  likelihood  must  be  computed  in  order  to  formulate 
the  EM  algorithm.  The  conditional  expectations  of  each  piece  of  complete  data  are  shown  below  and  are 
computed  using  results  from  Shepp  and  Vardi  [7]. 
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The  expected  value  of  the  complete  data  log  likelihood  is  added  to  the  natural  logarithm  of  the  prior  to  yield 

the  Q  function:  (21) 

Q  =  f [Up, fl’s, fl,, -  Pfe wr 


Step  6:  Maximize  the  Expected  Value 

This  step  requires  the  most  algebra,  since  the  derivative  of  Q  will  be  calculated  and  set  equal  to  zero  with 

respect  to  "Frc]  and  ^  d  ).  For  the  sake  of  brevity  only  the  results  of  each  derivative  will  be  shown, 
along  with  the  four  conditional  expectations  [6]. 
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Equation  23  is  referred  to  as  the  update  equation  for  the  object  . 

Second: 


P^iUNPOL  +  PCLl  +  POl2'\-^P^l-2UNPOL-POll  -  P0l2]  +  ?  =  [-£^A^P(?£l-  (24) 

The  most  important  operation  of  the  deconvolution  is  the  estimation  of  This  is  accomplished  by 

solving  for  the  roots  in  Equation  24.  Once  V'}  has  been  estimated  the  object  and  C’s  can  be  estimated. 


5.  Results  and  Analysis 


Preparatory  Explanation  of  Figures: 

The  simulated  polarimeter  results  are  shown  in  Fig.  3  &  4  below.  Both  figures  are  composed  of  3  images. 
The  left  image  is  the  truth  data.  It  represents  two  point  sources  with  pixel  spacing  equal  to  9  pixels.  The  two  other 
images  in  each  figure  show  the  results  of  the  deconvolution  for  2  and  3  channel  algorithms.  The  mean  squared  error 
(MSB)  is  displayed  at  the  end  of  each  figure  caption.  In  both  cases  shown  the  2  channel  results  have  nearly  double 
the  MSB,  compared  to  the  3  channel. 

The  figure  caption  also  defines  some  other  very  important  simulation  parameters.  First  is  the  lens  size  in 
centimeters.  Second  is  the  rg  value  in  centimeters.  The  third  value  requires  a  little  explanation,  since  it  differs  from 
middle  image  to  right  image.  To  ensure  consistency  in  comparisons  the  signal  strengths  must  be  relatively  equal. 
This  means  that  if  the  truth  data’s  two  point  sources  are  represented  by  200,000  photoelectrons  in  each  white  pixel 
in  the  2  channel  polarimeter,  the  3  channel  must  have  2/3  the  amount  of  photoelectrons,  because  it  splits  the  light 
signal  into  three  channels.  The  fourth  value  is  the  point  source  pixel  spacing.  Fifth  is  the  number  of  iterations  used  in 
the  deconvolution.  The  sixth  number  is  the  angle  of  polarization  in  the  observation  plane.  This  angle  directly 
impacts  the  values  of  transmission  shown  at  the  bottom  of  Table  1.  Bastly,  the  numbers  along  the  x-axis  and  y-axis 
show  the  size  of  the  image.  Simulations  for  the  120  cm  lens  used  an  image  size  of  32x32  pixels.  Simulations  for  the 
160  cm  lens  used  46x46  pixel  images. 


160  cm  Lens  Results: 


Fig.  3:  Results  for:  Bens  =160  cm;  ro  =  15  cm;  Signal  Strength  =  134k/200k  photoelectrons;  Point  Source  Spacing  = 
12  pixels;  Iterations  =  6000;  Angle  of  Polarization  =  300  degrees.  Mean  Squared  Brror:  3.46B^^  (3CH),  8.826B^^ 
(2CH) 


120  cm  Lens  Results 


Fig.  4:  Results  for:  Lens  =  120  cm;  Tq  =  15  cm;  Signal  Strength  =  134k/200k  photoelectrons;  Point  Source  Spacing  = 
12  pixels;  Iterations  =  6000;  Angle  of  Polarization  =  123degrees.  Mean  Squared  Error:  3.48E^^  (3CH),  7.71E^^ 
(2CH) 


6.  Limitations 


There  is  one  key  ratio  that  determines  how  blurred  an  image  will  be  after  it  passes  through  the  atmosphere. 
This  is  the  ratio  of  lens  diameter  to  ro  (T)/ro).  A  larger  ratio  contributes  to  more  blurring  in  an  image.  A  goal  in  this 
research  is  to  use  actual  lens  sizes  of  scopes  at  the  observatory  on  top  of  Haleakala. 

Conclusion 


The  degradation  effects  due  to  atmospheric  turbulence  can  be  devastating  in  imagery  analysis.  Polarization 
diversity  is  a  tool  that  can  be  used  to  overcome  the  effects  of  the  atmosphere  on  astronomical  imagery.  The  3 
channel  deconvolution  algorithm  is  shown  in  the  simulations  presented  here  to  surpass  the  2  channel  algorithm  in 
overall  imaging  performance.  This  paper  only  discusses  results  based  off  of  a  dual  point  source  image,  but  the  3 
channel  polarimeter  has  the  potential  to  work  for  different  types  of  astronomical  imagery.  There  is  still  much  work 
to  be  done  in  this  research  effort.  Some  hiture  tasks  include,  but  are  not  limited  to:  experimenting  with  other 
imagery  besides  two  point  source  imagery,  adding  blind  deconvolution  capability  to  the  3  CH  algorithms, 
developing  stopping  criteria,  and  compensating  for  thermal-camera  noise  as  part  of  the  solution. 
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